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Abstract. In this paper, we prove that the "quantization commutes with 
reduction" phenomenon of Guillemin-Sternbcrg 1101 applies in the context of 
the metaplectic correction. 
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1. Introduction 

Let K be a compact connected Lie group with Lie algebra t. An Hamilton- 
ian K-manifold (M, uj, $) is Spin-prcquantizcd if M carries an equivariant Spin c 
structure P with determinant line bundle being a Kostant-Souriau line bundle over 
(M, 2u>, 2$). Let Dp be the Spin Dirac operator attached to P, where M is ori- 
ented by its symplectic form. The Spin quantization of (M, w, <J?) corresponds to 
the equivariant index of the elliptic operator T>p, and is denoted 

e£jM) g R{K). 

Let A(M)(X) be the equivariant A-genus class: it is an equivariant analytic 
function from a neigborhood of G £ with value in the algebra of differential forms 
on M. The Atiyah-Segal-Singer index theorem [6] tell us that 

(1.1) QZin(M)(e x ) := / e^+^ x »A(M)(X) 

Jm 

for X £ t small enough. It shows in particular that Q^, in {M) e R(K) does not 
depend of the choice of the Spin-prcquantum data. 

This notion of Spin-quantization is closely related to the notion of metaplec- 
tic correction. Suppose that (M, u>, $) carries a Kostant-Souriau line bundle L u , 

1/2 

and that the bundle of half-forms kJ associated to an invariant almost complex 
structure J is well defined. In this case, (M, ui, $) is Spin-prcquantized by the 

1 /2 

Spin c -structure defined by J and twisted by the line bundle ® n / . The crucial 
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point here is that the corresponding Spin-quantization of (M, u>, $) does not depend 
of the choice of the almost complex structure. Note that the existence of the bundle 
of half-form kJ 2 is equivalent to the existence of a Spin structure on M [T4] . 

The purpose of this article is to compute geometrically the multiplicities of 
Ql pin (M) E R(K) in a way similar to the famous "quantization commutes with 
reduction" phenomenon of Guillcmin- Sternberg rj0l[Tni[Ta[2l[Tl[23[Tl[2i[2T]. 
This question was partially resolved in a previous paper [19] under the condition 
that the infinitesimal stabilizers of the i£f-action are abelian. C. Teleman also ob- 
tained some results [23] [Proposition 3.10] in the algebraic setting. 

The striking difference with the standard Guillemin-Sternbcrg phenomenon is 
the rho shift that we explain now. Let T be a maximal torus of K with Lie algebra 
t C t. Let tl C t* be the closed Weyl chamber. We will look at tl as a disjoint 
union of its open faces, the maximal one being its interior (t^_)°. Let p E (t5_)° be 
the half sum of the positive roots. At each open face r of t?_, we associate the term 
p T which is the half sum of the positive roots which are orthogonal to r. We note 
that p — p T E r is to the orthogonal projection of p on r. 

For any £ E t5_ and any face r containing £ in its closure, we consider the shifted 
symplectic reduction 

Ml :=^- 1 ^ + P - Pr )/K T 
where K T is the common stabiliser of points in r. Note that £ + p — p T E r when 

We arc particularly interested to the smallest face a of the Weyl chamber so 
that the Kirwan polytope A(M) := $(M) n i\ is contained in the closure of a. 
It is not hard to see that the Spin-prcquantum data on (M, descents to the 
shifted symplectic reduction M° when p is a dominant weight belonging to a. Then 
Qspin(-^I) E Z is naturally defined when p + p — p a is a regular value of the moment 
map. In general, the number Q sp i n {M^) is defined by shift-dcsingularization (see 
Section HU). 

By definition Q Bp i n (M°) vanishes when p + p — p a A(M), but in fact we can 
strengthen this vanishing property: Q sp i n (M^) = if p + p — p a does not belong to 
the relative interior of the Kirwan polytope A(M). 

Recall that the irreducible representation of K are parametrized by their 
highest weight p € K C t* . 

The main result of this paper is the following 

Theorem 1.1. Let (M, be a compact Spin-prequantized Hamiltonian K- 

manifold. Let a he the smallest face of the Weyl chamber so that A(M) C (f. 
We have 

Q£»(m)= Yl 2 spi „(A/;)vf . 



Let us give some ideas about the proof. The representation is equal to the 
Spin-quantization of the coadjoint orbit := K ■ (p + p). Then the shifting trick 
tells us that the multiplicity m^ of Vr- in Q^ in (M) is equal to 

[Q*U M ) ® Off)*]* = [Q? pi n(M x 0,)} K , 
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where C M is the coadjoint orbit with the opposite symplectic structure. As we did 

in [18l[T9], we study the expression [Q^ in (M x Ofj)] K by localizing the Riemann- 
Roch character on the critical points of the square of the moment map 

Here our treatment differs depending on whether the Kirwan polytope A(M) 
intersects the interior of the Weyl chambers or not (i.e. a = t+ or not). 

When a = t+ , we show that the multiplicity m M is calculated using the Riemann- 
Roch character localized near the zero level set of the moment map Q^. This case 
is (more or less) treated in [19]. 

The heart of this paper is when we work out the case a ^ t* + . We have $~ 1 (0) = 
0, but we show how to compute m M using the Ricmann-Roch character localized 
near 

K ■ {N"' n$- l {- Pa )) . 

Here N p ° denotes the submanifold of N = M x where the infinitesimal action 
of p a vanishes. 

Notations. Throughout the paper, K will denote a compact connected Lie 
group, and 6 its Lie algebra. We let T be a maximal torus in K, and t be its 
Lie algebra. The integral lattice A C t is defined as the kernel of exp : t — ► T, 
and the real weight lattice A* C t* is defined by : A* := hom(A,27rZ). Every 
/i G A* defines a 1-dimcnsional T-representation, denoted C M , where t — cxp(A) 
acts by := e i ^ tJ, ' x ' . We fix a positive Weyl chamber t5_ C t*. For any dominant 
weight /i £ := A* (1 1* , we denote by the irreducible representation with 
highest weight fi. We denote R{K) the representation ring of K. We denote 
R-°°(K) := homz(R(K),Z) its dual. An element E e R-°°{K) can be represented 
as an infinite sum E = X^gK m M^f > w ith m M £ 2. The multiplicity mo of the 
trivial representation is denoted [E] . If H is a closed subgroup of K, we have the 
induction map Ind^ : R-°°(H) -> Rr°°(K) which is the dual of the restriction 
morphism R(K) -> R(H). We see that [Ind^(-B)] A ' = [E] H . 

2. SPIN-QUANTIZATION OF COMPACT HAMILTONIAN JiT-MANIFOLDS 

Let M be a compact Hamiltonian iiT-manifold with symplectic form lo and mo- 
ment map $ : M — > fi* characterized by the relation 

(2.2) o(X M )u; = -d($,X), let, 

where Xm(itl) := 4:\t=oe~ tx ■ m is the vector field on M generated by X G t. 

In the Kostant-Souriau framework |13[ 122] , a Hermitian line bundle with an 
invariant Hermitian connection V is a prcquantum line bundle over (M, if 

(2.3) C{X)-Vx M =i{$,X) and V 2 = -iu, 

for every let. Here C(X) is the infinitesimal action of X G t on the sections 
of L u — > M. (L W ,V) is also called a Kostant-Souriau line bundle. Remark that 
conditions (|2.3|) imply, via the equivariant Bianchi formula, the relation (|2.2I) . 
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2.1. Spin-quantization: definitions. Let J be any invariant almost complex 
structure on M, not necessarily compatible with the symplectic form lo. Let 

RRj(M,-) 

be the corresponding Riemann-Roch character [TH] . We consider the complex tan- 
gent bundle (TM, J) and its complex dual TJM := homc(TM, C). We consider 
the complex line bundle 

Kj := detTJAf. 

If (M, lo, $) is prequantized by L u , a standard procedure (called the mctaplcctic 
correction in the geometric quantization literature) is to tensor L u by the bundle 

1/2 

of half-forms k J [17]. We may consider the equivariant index 
(2.4) Qj{ M ) : = ejRRj (M, L u ® kJ 2 ) 

where ej = ±1 is the quotient of the orientations defined by lo and by J. In 
Proposition 12.21 we check that Q 1 ^ (M) has a meaning when the tensor product 
L = L u ® kJ 2 is well defined (even if neither nor nj 2 exist). 

The almost complex structure J defines a Spin c structure Pj on M with de- 
terminant line bundle det Pj = Kj . If we twist the Spin c structure Pj by any 
complex line bundle L we get a Spin c structure Pjx with determinant line bundle 

det Pj^ = L 2 ® Kj 1 . 

See [H[Tg]. 

We make the following basic observation. 

Proposition 2.1. Let (M,u>,<$>) be a Hamiltonian K-manifold. The following as- 
sertions are equivalent: 

a) For any invariant complex structure J there exists a K-equivariant line 
bundle L such that L 2 ® k^ 1 is a prequantum line bundle over (M, 2u>, 2$). 

b) There exist an invariant complex structure J and a K-equivariant line bun- 
dle L such that Kj 1 <E> L? is a prequantum line bundle over (M, 2u>, 2$). 

c) There exists an equivariant Spin c structure P such that its determinant line 
bundle det P is a prequantum line bundle over (M, 2w,2$). 

When the previous assertions holds, we says that (M,u>, $) is Spin-prcquantized, 
either by the Spin c -structure P, or by the data (J,L). 

Proposition 2.2. Let (M, w,$) be a Spm-prequantized Hamiltonian K-manifold. 
The equivariant index (M) := e,jRR T (M, L) does not depend of the choice of 
the Spin-prequantum data (J,L). In fact Q 1 ^ (M) coincides with the equivariant 
index of the Spin c Dirac operator T>p attached to the Spin c -structure P. 

Definition 2.3. Let (M, lo, $) be a Spin- prequantized Hamiltonian K-manifold. 
The Spin- quantization of (M, w, $) is defined as the equivariant index Q I j(M), 
and is denoted 

Q«(M) e R(K). 
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Proof of Propositions \2.1\ and \2.2i We have obviously a) ==> b) , and we get 
b) => c) by taking the Spin c sructure P j i . Let us prove c) ==>■ a) . 

Let P be a Spin c -structure on M such that its determinant line bundle dct P 
is a prequantum line bundle over (M,2ui). Let Sp be the corresponding bundle 
of spinors. Let Pj and Sj be respectively the associated Spin c -structure and the 
bundle of spinors on M associated to an invariant almost complex structure J on 
M. Since Sp,Sj are irreducible Clifford modules, we have 

(2.5) S P ~Sj®L 

where L is the line bundle defined by L := hom c i(5j, Sp). From (|2.5|) we get that 
the line bundle 

dct P = L 2 ® det Pj 
= L 2 <8kj 1 . 

is a prequantum line bundle over (M, 2lo, 2$). 

Let P be the Spin c structure attached to a data (J,L). The symplectic orienta- 
tion on M defines a decomposition on the bundle of spinors, Sp = Sp © Sp, and 
the corresponding Spin c Dirac operator V P maps T{Sp) to Y{Sp). 

On the other hand the almost complex structure on M gives the decomposition 
AT* M <g> C = © 4J - A*'- 7 T*M of the bundle of differential form. The corresponding 
bundle of spinors is Sj := A '* T*M and the complex orientation induces the split- 
ting Sj =Sj®Sj with Sj := A°> eue,l T*M. The Dolbeault Dirac operator ~3 L +~8\ 
maps ® L) to T(Sj © L), and the Riemann-Roch character RR^f(M,L) is 

defined as the equivariant index of the elliptic operator 

d L + d\ : T{Sj ® L) — ► T(SJ (g> L) 

If ej = ±1 is the quotient of the orientations defined by u> and by J, one has 
that 

s$ = sj ej ® Z. 

Hence (M) = ejRR^ (A/, L) is defined as the equivariant index of the Dolbeault 
Dirac operator + di viewed as an elliptic operator T>~^ from T(Sp) to T(Sp). 

Finally we know that lndex K (T>p) = Index if (2?^) since the first order elliptic 
operators Vp and T>~t have the same principal symbol [|5]. □ 

In the remaining part of this paper, we find convenient to work with the following 

Definition 2.4. A Hamiltonian K -manifold (M,u), $) is Spin-prequantized by L if 
there exists an invariant almost complex structure J compatible with to such that 
L 2 ® Kj is a Kostant-Souriau line bundle over (M, 2w,2$). 

We remark that sj = 1 when J is compatible with lu. Moreover, the Riemann- 
Roch character RR^(M, — ) does not depend |T5] on the choice of the compatible 
invariant almost complex structure J : we denote it simply by RR K {M, — ). 

Finally, when a Hamiltonian manifold (M, u>, $) is Spin-prequantized by the line 
bundle L, its Spin-quantization is defined by 

Q« ln (M) :=RR K (M,L). 
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2.2. Functorial properties. We summarize the functorial properties of <2 sp m m 
the next 

Proposition 2.5. • If (M, uj, is a Spin-prequantized Hamiltonian K -manifold, 
and H is a closed subgroup of K then the restriction of Qf^ in (M) to H is equal to 

• If (Mj,uij,<frj) are Spin-prequantized Hamiltonian Kj-manifold, for j = 1,2, 
then Mi x M 2 is a Spin-prequantized Hamiltonian K\ X K 2 -manifold and 

Q^* K2 (Mx x M 2 ) = Q«\ n (Mi) ® Q«L(M 2 ) 

in R{Ki x K 2 ) ~ R(K{) <g> R{K 2 ). 

• If (M, lvm-, $m) and (N, lon, &n) o,re Spin-prequantized Hamiltonian K -manifold, 
then M x N is a Spin-prequantized Hamiltonian K -manifold and 

Qf P JM x N) = Q« in (M) ■ Q« in (N), 

where ■ denotes the product in R(K). 

• A Spin-prequantization on (M, w,$) induces a Spin-prequantization on M := 
(M, — uj, — The Spin- quantization of M corresponds to the dual of the Spin- 
quantization of M: 



Proof. The first three points are direct consequences of the functorial properties 
of the index map. Let us prove the last point. One see that if (L, J) is a Spin- 
prcquantum data for M then (L , — J) is a Spin-prcquantum data for M. Then 
we have for X € t small enough 

Q* in (M)(e x ) = [ e*-"- <*' X »A(M)(X) 

JM 



(*(!•>+{**)) A{M)(X) [1] 

M 



= QZUM)(e x ). [2] 

The relation [1] is due to the fact that the differential form A(M)(X) has real 
coefficients. Since X — > Q^p in {M)(e x ) are analytic functions, the identity [2] shows 
that Qj£ in (M)(fc) = Qf pin (M)(k) for any k 6 K. In other words the (virtual) 
representation Qf^ in (M) corresponds to the dual of the (virtual) representation 

Q&JM)- □ 

2.3. Spin-quantization of coadjoint orbits. Let p £ K be a dominant weight. 
Let u be a face of the Weyl chamber such that p, €a: hence the stabilizer subgroup 
contains K a . We will restrict the onc-dimcnsional representation C M of to 
the subgroup K a . 

Let p be half the sum of the positive roots, and let p a be half the sum of the 
positive roots which arc orthogonal to a. Note that p — p a belongs to er, hence 
/i + p — p a belongs also to a for any p € a. The coadjoint orbit 



Ol :=K-(p + p-p a ) 
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is Spin-prequantized by the compatible complex structure and the line bundle L = 
K Xk„ C m . We have 

Q&nTO = RR K {K/K^Kx Ka C^) 
= V K 

Thanks to Proposition [231 we know that Q^ in (Ofy = (V* )*, where 0° be the 
coadjoint orbit with the opposite symplectic form. 

We have seen that the same irreducible representations can be realized as the 
Spin-quantization of the coadjoint orbits 0^ where a is a face of the Weyl chamber 
containing \x in its closure. 

2.4. Spin-prequantization commutes with reduction. We consider first the 
case of a Hamiltonian iT-manifold (N, u>, $), not necessarily compact, which is Spin- 
prequantized by L. We suppose that is a regular value of Let Nq := ^~ 1 (Q)/H 
be the orbifold reduced space with its canonical symplectic structure luq. 

Lemma 2.6. The orbifold line bundle Co := (L\$-irff\)/H Spin-prequantizes (No, luq). 

Proof. The fiber Z = $ _1 (0) is a smooth _ff-invariant submanifold of N. Let 
7r : Z — > Z/H = No be the projection. Recall that the symplectic structure ujo 
on A^o is defined by the relation tt*(luq) = lu\z- Let Liu the Kostant-Souriau line 
bundle on (N, 2w, 2$) such that 

(2.6) L 2 = L 2u) <g> kj. 

Here J is a compatible invariant almost complex structure on N. We have TM\z = 
TZ © J(i)z) where \)z C TZ is the trivial bundle given by the infinitesimal action 
of H. Since TZ ~ 7r*(T7V ) © f) Z we get 

TA/| 2 ~7r*(TiV )©()2© J(t) 2 ). 

Hence J induces a compatible almost complex structure Jo on (No,u>o), such that 
(kj\z)/H = k Jo . 

The line bundle Liuq = (-^wlz)/-^ is a prequantum line bundle on (Nq,Wq). 
Finally if we restrict (|2.6p to Z, we get 

Cl = L 2 u a ® k Jo . 

after taking the quotient by H. We have proved that (Jo, Co) Spin-prequantizes 
(JVo.wo)- □ 

For the rest of this section we consider a compact Hamiltonian A'-manifold 
(M, that we suppose Spin-prequantized by the line bundle L. 

Let t be a face of the Weyl chamber, and let K T be the commun stabilizer of 
points in r. Following Guillemin-Sternberg [llj . we introduce the following K T - 
invariant open subset of t*: 

U T = K T -{£e t* + \K 6 c K T } =K T -\Ja. 

By construction, U T is a slice for the coadjoint action: this mean that the map 
K x U T ,(k,£) h- > k ■ £ factors through an inclusion K x^ T U t £*. 

The symplectic cross-section theorem [TT] asserts that the pre-image Y T = $ _1 (i7 T ) 
is a symplectic submanifold : we denote uj t the restriction of lj to Y T . The action 
of K T on (Y t ,oj t ) is Hamiltonian, where the restriction of $ to Y T is a moment 
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map. Since p — p T is a if T -invariant element, we can use the translated moment 
map <& r : Y T — > 6* defined by 

* T =*|y r -(p-/J T ). 
Lemma 2.7. T/ie symplectic slice (Y Ti uj t , $ T ) is Spin-prequantized by the line bun- 
dle L T := L\y T ■ 

Proof. We consider the open subset K Xk t Y t of M and the projection 
7r : K y.K T Y T — y K/K T . We can suppose that the Spin-prequantum data, when 
restricted to K x k t Y t , is given by (J, L) where J is a compatible almost complex 
structure on K Xk t Y t defined as the "sum" of the compatible almost complex 
structures J a and J T : J a on K/K T and J T on Y T . 

When we restrict the identity L 2lu = L 2 ® Kj 1 to Y T we get 

(2.7) L 2u \ Yt = (L\ Yt ) 2 ® K-j] ® C 2(p _ Pt) . 

We consider the following line bundle on Y T : 

L 2Ur := L 2u \y t ® C 2( p -p T )- 

The relation (|2.7|) is then L2w T = (L\y t ) 2 <8> «j • Since L 2uJt is a X T -equivariant 
prequantum bundle over (Y T , 2oj t , 2$ T ), we conclude that (y r ,w T ,$ T ) is Spin- 
prequantized by the data (J T ,L T ). □ 

Let us consider the case where r = a is f/ie smallest face of the Weyl chamber 
so that moment polyhedron A(M) := <£>(M) n t+ is contained in the closure of a. 
Then the symplectic slice Y a is equal to < f>~ 1 (cr), and the action of the subgroup 
[K a , K a \ is trivial on it [15] . 

We will then consider the Hamiltonian action of the center Z a = Z(K a ) on Y a . 
The map § a : Y a —y 6* takes values in 3* = Mcr c t* and corresponds to the 
moment map relative to the action of Z a on (Y„,oj a ). We know that {Y ai u> ai <^ a ) 
is Spin-prequantized by L a := L\y a . 

For each dominants weights p which belongs to the closure of a , we consider the 
symplectic reduction 

m; = §-\oi)iK 
= <s>- l {p)/z a . 

For the rest of this section we fix a dominant weight p £ ~d such that 
p + p — p a £ A(M), and we explain how one defines the Spin-quantization 
of the (possibly singular) reduced spaces M p . 

Let A C 3* be the rationnal vector subspace generated by {a — b \a, b £ A(M)}. 
Let 3^ C la be the subspace orthogonal to A, and let Z^ C Z a be the correspond- 
ing subtorus. 

Lemma 2.8. The torus Z^ acts trivially on Y a and on the line bundle L a <g> C_ p . 

Proof. By definition of 3^, = d($ a ,X) = -i{XY„)u a on Y a for any X £ 3^. 
Hence the torus acts trivially on Y a . Let L 2LOa be the Kostant-Souriau line 
bundle over (Y a , 2uj a , 2$ (T ) so that L\ = L 2Ua ® Kj a (sec Lemma [2T7| . We have on 
the section of L 2ula the following equality of linear operators: 

C(X) - Vx M = *(2$ CT , X), VXe ia . 
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If one takes X G 3^, the function y G 1 — ► ($ CT (y), X) is constant equal to (p, X). 
Finally 

C(X)-2i(p,X) = 0, VIejf 

as an operator on the section of Li Ua . In other words, the torus acts trivially 
on ® = (icr ® C- M ) 2 ® Kj\ Since acts trivially on Kj a , we conclude 
finally that Z 1 ^ acts trivially on the line bundle L a ® C_ M . □ 

Let Z' a C be another subtorus such that Z a = Z^ x Z' a : the dual of its Lie 
algebra 3^ is identified with A C 3*. We look now at (Y a ,u> a ) as a Hamiltonian 
.Z^-manifold with moment map 

K = ®W„ -(jM + p- p a ). 

The Z^-equi variant line bundle L' a := L a ®<C-^ Spin-prequantizes the Hamiltonian 
Z^-manifold {Y a ,Ua,K)- 

If G A is a regular value of we know after Lemma. [2.61 that the orbifold 
reduced space (M^, lu°) is Spin-prequantized by the line bundle 

K ■= (i|*-i (M) ®C^) /Z' a , 

and its Spin-quantization Qs P i n (M°) is defined like in Definition ^. 31 In the general 
case where G A is not necessarily a regular value of & a we proceed by shift 
desingularization. For e G A small enough and generic we consider the orbifold 
reduced space 

M; +E := (Kr 1 (e)/Z' a = K 1 (P + e)/Z' a 
and its orbifold line bundle 

c; +e -.= (LU-i ( ^®C_ M )/^. 

The following crucial fact is proved in Section [3^1 

Theorem 2.9. The Riemann-Roch number RR(M° +e , £° +e ) G Z does not depend 
of the choice of a generic and small enough e G A . 

Thanks to the last Theorem we can define the quantization <2 sp i n (Ai^) e Z of 
the (possibly singular) reduced space M° for p E K P\a. 

Definition 2.10. Let p G K n a. 

• If p + p — p a G A(M ), the integer Q Bp i n {M°) G Z is defined as the Riemann- 
Roch character RR(M^ +e , CJ l+£ ) for e G A generic and small enough. 

• Ifp + P-Pai A(M), we sei Q spin (M£) = 

Remark 2.11. If p + p — p a does not belongs to the relative interior of A(M), we 
can choose e so that p + p — p a + s ^ A(M). Then the reduced space M° +£ is empty 
and the corresponding Riemann-Roch character RR(M° +e , £° +£ ) vanishes. Hence 
Q Bpin (Mp = 0. 
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3. Spin-quantization commutes with reduction 



Let (M, to, $) be a compact Hamiltonian A-manifold which is Spin prcquantized. 
We are looking to a geometric interpretation of the multiplicity, denoted m^ , of the 
representation Vjf into Qf£ in (A/"). 

The main result of this paper is the following 

Theorem 3.1. Let a be the smallest face of the Weyl chamber so that <J>(M)nt!j_ C 
(7. For /i G K, we have 



In this section wc introduce the main tools needed for the proof of Theorem 1 3. II 

In Section 13.11 we recall the notion of tranversally elliptic symbols. 

In Section 13.21 we recall the Witten's way of localization the Riemann-Roch 
character [TS]. We recall in Proposition 13.71 the criterium observed in [TO] for the 
vanishing of the invariant part of the localized Riemann-Roch character. 

In Section l3~3] we recall an induction formula proved in [THJ [T9] for the localized 
Riemann-Roch character. 

In Section 13. 4\ we prove Theorem 13.11 when K is a torufl We give by the 
same way a proof of Theorem 12.91 which is essential to the definition of the Spin- 
quantization of the (possibly singular) reduced spaces M°. 

3.1. Elliptic and transversally elliptic symbols. Here we give the basic def- 
initions from the theory of transversally elliptic symbols (or operators) defined 
by Atiyah-Singer in [I]. For an axiomatic treatment of the index morphism see 
Bcrlinc-Vcrgne [7] [8] and Paradan-Vergne [20] . For a short introduction see [18] . 

Let X be a compact A-manifold. Let p : TX — > X be the projection, and let 
(— , —)x be a A"-invariant Ricmannian metric. If E°, E 1 arc A-cquivariant complex 
vector bundles over X, a A-equivariant morphism h G T(TX,hom(p*E°,p*E 1 )) is 
called a symbol on X. The subset of all (x, v) G TX wher<3 h(x,v) : E® — > E\ is 
not invertible is called the characteristic set of h, and is denoted by Char(/i). 

In the following, the "product" of a symbol h by a complex vector bundle F — ► 
M , is the symbol 



defined by h (g) F(x,v) = h(x,v) ® ld Fx from E® ® F x to El ® F x . Note that 
Char(/i (g> F) = Char(/i). 

Let TkX be the following subset of TA' : 



A symbol h is elliptic if /i is invertible outside a compact subset of TX (i.e. 
Char(/i) is compact), and is K -transversally elliptic if the restriction of h to TkX 
is invertible outside a compact subset of TkX (i.e. Char(/i) n T#- 2 X is compact). 
An elliptic symbol h defines an element in the equivariant K-thcory of TX with 
compact support, which is denoted by Kr- (TX), and the index of ft- is a virtual finite 
dimensional representation of K, that we denote Index^(/i) G R(K) [2j [3j [4[ [5] . 



This situation was already handeld in 1191 . 
The map h(x,v) will be also denote h\ x (v) 




h®F 



T K X = {(x, v) G TX, (v, X x (x)) x = for all X E t} . 
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Let 



where the map 



be the i?(K)-submodule formed by all the infinite sum ^ 

\i £ K i— > rrifi £ Z has at most a polynomial growth. The _R( K) -module R^~ C °°(K) is 
the Grothendieck group associated to the trace class virtual if-representations: we 
can associate to any V £ R^ C °°(K), its trace k — > Tr(fc, V) which is a generalized 
function on If invariant by conjugation. Then the trace defines a morphism of 
i?(ff)-module 



(3.8) 



K 



A K-transversally elliptic symbol h defines an element of K^Tr-A?), and the 
index of h is defined as a trace class virtual representation of K, that we still denote 
Index£(/i) £ Rt c °°{K). 

Remark that any elliptic symbol of TX is if-transversally elliptic, hence we have 
a restriction map K^f (TX) — > Kjf(TjfA'), and a commutative diagram 



(3.9) 



K K (TX) 



Index?; 



K K (T K X) 
Indexj 



R(K) 



Rr c °°(K) 



Using the excision property, one can easily show that the index map Index w : 
Kif(TifW) — * i? t ^.°°(A') is still defined when U is a Jf -invariant relatively compact 
open subset of a K- manifold (see [18] [section 3.1]). 

Suppose that M is a if-manifold equipped with an invariant almost complex 
structure J. Let us recall the definition of the Riemann-Roch character RR^j (M, — ). 

The complex vector bundle (T*^/) ' 1 is if-equivariantly identified with the tan- 
gent bundle Ti\/ equipped with the complex structure J. We work with the Hermit- 
ian structure on (TM, J) defined by : (v, w) := Sl(v, Jw) — ifl(v, w) for v, w £ TM. 
The symbol 

Thom(M, J) £ L (M, hom(p*(Ag ue,l TM), p*(A^TM))) 
at (m, v) £ TM is equal to the Clifford map 
(3.10) c m (v) : f\™ en T m M — > f\^ dr £ m M, 

where c m (v).w = vAw — i(v)w for w £ AJT TO M. Here i(v) : AjT m M — » A* _1 T m M 
denotes the contraction map. Since c rn (v) 2 = — ||v|| 2 Id, the map c m (v) is invertible 
for all v 7^ 0. Hence the characteristic set of Thom(M, J) corresponds to the 
0-section of TM. 

Let £ be a if-equivariant complex vector bundle over M. It is a classical fact 
that the principal symbol of the Dolbcault-Dirac operator 8e + d E is equal to the 
following elliptic symboQ 

c E := Thom(M, J)(g>E, 

see [3]. Since M is compact, the symbol c E is elliptic and then defines an element 
of the equi variant K-group of TM. 



3 Here we use an identification T*M ~ TM given by an invariant Riemannian metric. 
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Definition 3.2. The Riemann-Roch character RR^(M,E) G R(K) is defined 
equivalently 

• as the topological index of Ce G Kif(TM), or 

• as the analytical index of the Dolbeault-Dirac operator 8e + d E . 

3.2. Localization of the Riemann-Roch character. Let (M, u>, $) a compact 
Hamiltonian if -manifold Spin-prcquantized by (L, J) where J is a compatible al- 
most complex structure on M. The Riemann-Roch character attached to J is just 
denoted RR K (M, — ). 

By definition the Spin-quantization of (M, oj, $) is 

Qf pia (M) ■= RR K (M, L) e R(K). 

We recall the Witten's deformation of the Riemann-Roch character [TSJ [H] . We 
use in all this paper an isomorphism t* ~ t defined by a A"-invariant scalar product 
on t* . In order to simplify the notation, we use the same symbol for £ G 6* and its 
corresponding clement in t. 

The moment map $ is seen as en equivariant map from M to 6. We define the 
Kirwan vector field on M : 

(3.11) K m = ($(m)) M (m), meM. 

Definition 3.3. TTie symbol c^ = Thom(M, J) ® L pushed by the vector field k is 
the symbol c^ defined by the relation 

c L \ m {v) = Thom(M, J) ® L\ m (v - « m ) 

/or any (m, u) G TM. 

Note that c|| m (t>) is invertible except if v = K m . If furthermore v belongs to 
the subset TjfM of tangent vectors orthogonal to the if -or bits, then v = and 
K m = 0. Indeed K m is tangent to K ■ m while v is orthogonal. 

Since k is the Hamiltonian vector field of the function ^i||$|| 2 , the set of zeros 
of k coincides with the set Cr(||$|| 2 ) of critical points of ||$|| 2 . Finally we have 

Char(c£) n TjfM ~ Cr(||$|| 2 ) 

= [J K ■ (m 13 n $ _1 (/3)) 

PdB" ' 

where B C t* is a finite subset parametrizing coadjoint orbits if ■ /?. 

We are interested to the restriction of the elliptic symbol on an invariant 
open subset U C M. Note that the set Char(c||(y) n T K U ~ Cr(||$|| 2 ) n C/ is 
compact when 

(3.12) aWnCr(||$|| 2 ) = 0. 
When (|3.12|) holds wc denote 

(3.13) Qf(LT) :=lnde^(c K L \u) G 

the equivariant index of the transversally elliptic symbol c-Jfj- 

For any /? G £>, we consider a relatively compact open invariant neighborhood 
[7/3 ofCp such that Cr(||$|| 2 ) n Up = Cp. 
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Definition 3.4. We denote 

Qf(M)€Rt c °°(K) 
the index of the transver sally elliptic symbol | Up ■ 

Everything can be defined if we replace the line bundle L by any equivariant 
complex vector bundle E. We can consider the pushed symbol c%, and the localized 
Riemann-Roch characters 

RB^(U,E):=Index^(c%\ u ) and RRf(M,E):=Iadexu g (c%\ U0 ). 
A direct application of the excision property [18j gives that 

(3-14) Q* n (M) = J2 Qp( M )- 

pee 

If we work with RR$ (U,E), we have 

(3.15) RR%{U,E)= Y RRp(U,E). 

/3eBn<s>(u) 

The decomposition (|3 . 14[) and (|3.15[) will be used in the next chapters when one 
want to compute the multiplicity, denoted [Q^, in (M)] K , of the trivial representation 
in Qf pin (M). We have 

and we finish this section by recalling a criterium under which one has [Qp (M)] K = 
0. 

Let (3 be a non-zero element in £: let Tp C K be the torus generated by f3. 
For m <E M" , let a™, • ■ • , a™ be the real infinitesimal weights for the action of Tg 
on the fibers of T m M (we equip the fibers of T m M/T m M^ with a Tg-invariant 
complex structure). 

Definition 3.5. Let us denote by Tr/3\T m M\ the following positive number 

i 

Ttp\T m M\ :=Y,\(<x?,P)\ ■ 

i=l 

Note that m € M@ i— > Tr^|T m Af| is constant along a connected component of 
Af 3 . We see also that the expression Tr^ is well defined for any iJ-equi variant 
real vector bundle E — > P, when f3 6 f) acts trivially on P. 

Example 3.6. The map /3 £ E ^ Tr^ 1 6| is invariant under the adjoint action. 
When (3 belongs to the Weyl chamber, one has Tr^ 1 6| = 2(p, (3). Note that Tr^|t| < 
2|H| \\P\\ for any Pet. 

We have proved in |19j the following nice criterium. 

Proposition 3.7. Let (3 ^ in B. The multiplicity of the trivial representation in 
Qp (M) is equal to zero if 

(3.16) || [3 || 2 +^Tt \T m M\ > Tr \t\, V m e M p n $" 1 (/3). 



14 



PAUL-EMILE PARADAN 



Remark 3.8. Note that condition L8. 1 6\) is equivalent to 
(3.17) || $(m) \\ 2 +^Tr Hm) \T m M\ >Tr* (m) |t|, V m G C t 



0- 



If the critical set Cp decomposes in a finite disjoint union of closed A'-invariant 
subset Cp = UjCjj, we consider invariant open neighborhood CP of such that 

[/f n Cr(||$|| 2 ) = CP p , and wc define 

Q*(M):= Index* (c K |^) G R te °°(K) 

Then the generalized character Q|f(M) is equal to the sum Q^, (M) and Propo- 

P J c /:3 

sitionGTT] tells us that [Q% (M)] K = if (j3~T71) holds on CL 

p 

3.3. Induction formulas. Let H be a compact connected Lie group. Let H ■ a 
be a coadjoint orbit. Let (N,lon, 3?at) be an Hamiltonian i7-manifold which is not 
assumed to be compact. But we assume that $at is proper near H ■ a: the pullback 
$^(C) is compact if C C f)* is a small enough compact invariant neighborhood of 
if -a. 

Let H a be the stabilizer of a G f)*, and let Y" a be a symplectic slice near H -a: Y a 
is a i? Q -invariant symplectic manifold of N such that $jv(ia) C t)a an( i such that 
H XH a Y a is diffeomorphic to an invariant open neighborhood of • a). Wc 

will work with the following moment map on Y a : 



Let N x H ■ a be the Hamiltonian if-manifold, with moment map £) = 
$jy(n) - £. Let 

RR"(N x IPa, - ) 

be the Riemann-Roch character localized near the compact subset 4> _1 (0) C N x 
H ■ a. Let 

RR^(Y a , - ) 

be the Riemann-Roch character localized near the compact subset ^y 1 (0) = $] v 1 (a) C 
Y a . 

Let Ind" Q : R"°°(H a ) -> R-°°(H) be the induction map. If E and F are 
respectively iif-equivariant complex vector bundles on N and -ff • a, we denote 
EMF their product. We have proved in [TB] (see also Proposition 4.13 in [TH]) the 
following induction formula 

Proposition 3.9. For any equivariant complex vector bundles E — > N and F — > 
H ■ a, we have 

RR*(N xlT^,E®F) = Ind H Ha [RR^(Y a ,E\ Ya ® F\ {a} ) 
The last Proposition gives in particular that 
(3.18) [RR*(N xir^^^F)]" = \RR^(Y ai E\ Ya ®F\ {a} ) f 
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3.4. The torus case. Let T be a compact torus, and let (M, u>,$) be a compact 
Hamiltonian T-manifold which is Spin-prequantizcd by the data (J, L). Wc suppose 
that J is compatible with uj. The irreducible representation of T is parametrized by 
the lattice Tc t*: at each fi G T we associate the one-dimensional representation 

We write Qj in (M) = ^ ^m^C^, and one wants to show that the multiplicity 
m M is equal to the Spin-quantization of the (possibly singular) reduced space := 

Wc fix once for all fi S T. And we apply the Witten deformation procedure to the 
Hamiltonian T-manifold (M, u>, $ — fx) which is Spin-prequantizcd by (J, L ® C_ M ). 
We have 

n V = J2 [^(Af,i®C_ M )] 

where 2? M parametrizes the critical points of ||$ — fi\\ 2 . Here the criterion (|3.16|) 
holds for any non-zero (3 since the Lie algebra t is abelian. We have then 

r i T 

nv = RRl{M,L®C-^) . 

In particular m M = if fi ^ <E>(M). When /i S ^(-M), we consider a small neigh- 
borhood U of ( f )_1 (^) C M so that Z7n Cr(||$ - /i|| 2 ) = ^"Hm)- We know then 
that 



(3.19) m„= RRi_JU,L\ v ®C-^) 



T 



3.4.1. First case: fi is a regular value o/<I>. We consider the orbifold reduced space 
M„ = <&~ l (fi)/T which is equipped with a canonical symplectic form lo^. Let 
RR(AI^, — ) be the Riemann-Roch character attached to a compatible almost com- 
plex struture. We prove in |18| that for any complex vector bundle E — > U 

(3.20) [RRl^U, E)] T = RR(M„, £) 

where £ = E\^-i^/T is the induced orbifold bundle on M^. If we take E = 
L\u <8> C-p on sees (thanks to Lemma [2~6| that 

4 = (£k-i(M)® c -M)/ T 

is an orbifold line bundle which Spin-prcquantizcs (M M ,u; M ), and (|3.20j) gives to- 
gether with (f3TT9]) that 

m, = RR(M^C^) = Q spin (M AI ). 

3.4.2. Second case : fi is a not (necessarilly) a regular value o/$. Let A C t* be 
the rationnal vector subspace generated by {a — b \a, b G $(M)}. We work here with 
a weight fi <E <&(M) so that the polytope $(M) lives in the affine subspace fi + A. 
Let tA C t be the subspace orthogonal to A, and let Ta C T be the corresponding 
subtorus. 

Lemma 3.10. The group Ta acts trivially on M and on the line bundle L ® C_ M . 
Proof. See the proof of Lemma 12.81 □ 
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Let T' C T be another subtorus such that T = Ta x T'\ the dual of its Lie 
algebra t' is identified with Act*. We look now at (M,u>) as a Hamiltonian 
T'-manifold with moment map 

$':=$- (j, : M — ► A = (t')* 

The T'-equivariant line bundle U := L ® C-^ Spin-prequantizes the Hamiltonian 
T'-manifold (M,w,&). Let U be a small neighborhood of ^'^(O) in M. The 
generalized character RR^_^(U, L\u ® C-^) belongs to i? -00 (T') and corresponds 
to the localized Riemann-Roch character 

rr£(u,l'\u). 

We deform the moment map $' in $' — e where e is a small element in A . We 
have proved in [19] [Proposition 4.14] the following 

Lemma 3.11. • If e is small enough, the critical set of ||$' — e\\ 2 does not intersect 
dU , so that the localized Riemann-Roch character RR^,_ e (U, — ) is well defined. 
We have RR%, (U, L'\u) = RR%i_ e (U-,L'\u) if e is small enough. 



Now we are left to the computation of m M = RR^,,_ e (U, L'\u) 
is small enough. We start with the decomposition 

RR%,_ e (U,L'\u) = ^2 RR^,,_ e p(U,L / \ u ) 



T' _> 

when e G A 



where RR%,_ E a(U, — ) denotes the Riemann-Roch charcater localized near the com- 
pact subset l/P fl (<f>') _1 (/3 + e). We have proved in [H)] [Lemma 4.16] the following 



Lemma 3.12. If e is small enough we have 



RR%i _ St p(U,L'\u) 



T' 



when (3^0. 



At e G A small enough and generic we associate the orbifold M^+g 
<f> -1 (/i + e)/T' which is equipped with the orbifold line bundle 



C fl+S = (ik- 1(/1+ e)®C_ M ) IT'. 



Let RR(Mn+ e ,—) be the Riemann-Roch map associated to a compatible almost 
complex structure. If we use (|3.20[) together with the Lemmas 13. Ill and 13. 121 we get 

Theorem 3.13. The multiplicity m^ is equal to the Riemann-Roch number 
RR(M fl -^ e , C^+e) G Z where e G A is small and generic. 

We prove here that the quantity RR(M fl+e , C^+s) does not depend of the choice 
of e small and generic: it is the definition of the Spin quantization, denoted 
Qspin(-^i), of the (possibly singular) reduced space M^. 



3.4.3. Proof of Theorem ] 2. PI The same kind of proof work for Theorem l2.9l We con- 
sider an invariant relatively compact neighborhood U a> ^ of $ o r 1 (/i) = 
§~ 1 (p + p— p a ) in the slice Y a so that Cr(||$«7 - /i|| 2 ) n = ^ x {p). Thanks to 
Lemmas 13.111 and 13.121 we know that the Riemann-Roch character 

RR%'_ JJJwL 1 ) Gi?-°°(^) 
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are well defined for e <E A small enough, and they do not depend of the choice of 
e. If £1, £2 G A are small enough regular values of Q a — p we get thanks to (|3.20|) 
that 

z' 



RR(M^ +ei ,C; + J 



RR 
RR 



-IMS 



,{U~L') 



- RR(M° +e2 ,£° +£2 ). 
4. Proof of Theorem 13.11 



Let (M, uj, $) be a compact Hamiltonian Jv-manifold which is Spin prcquantized. 
Let a be the smallest face of the Weyl chamber so that $(M) n tl Co 7 . Let p be 
a dominant weight, and let m p be the multiplicity of V p in Q^ in (M). 

Let be the coadjoint orbit K ■ (p, + p). Since the dual representation (V^f )* 
can be realized^ as Qip hl (O p ), we know by the shifting trick that 

Now we work with the Hamiltonian X-manifold N = M x O p with moment map 
$iv(m>£) = - £• The Witten's deformation on AT gives Q^ m (M x £Q = 

SagS^ 2^(M x O^i) where 2? M is a finite set parametrizing Cr( || <& jv || 2 ) - We have 
then 

(4.21) m 



£ [ 2 ^( M x °^ 



1 A" 



We remark that does not appears in £> M when a ^ t* + , since p + p ^ $(M). 
The main point of this section is the following 

Proposition 4.1. • If p ^ a, the identity \3. 17\ ) holds on Cp for any [3 £ . 

Hence m M = 0. 

• If p S a, the identity !{3.17\ ) holds on Cp for any (3 7^ — p a . Then 



% = [e-^xo„)] 



A 



When o" = t!j_, we have p a = and Proposition ^. ll tell us that the multiplicity m^ 



id equal to [Qff(M x O^)] K for any p 6 A'. In particular im t = if p + p £ $(M). 
When a ^ i* + and p £a, we precise Proposition 14.11 as follow. The generalized 



character Q_„(M x C M ) is defined as the index of a transversally elliptic symbol 
living in a neighborhood of 

C- p .=K{NP-n*„\-p a )). 

Let K Pa be the stabilizer subgroup of p a . Let W(K Ptr ) C W be the Weyl 
subgroup of K Pcr . A direct computation gives that 



C- L 



u 



with 



K (M p ° n + /£>)- Pa) x {w(p + p)}) 



C M is the coadjoint orbit C M with the opposite symplcctic structure. 



18 



PAUL-EMILE PARADAN 



We are particularly interested in the component C_ P(Tj g. Let us denote C- Pa . ou t 
the union of the C- Pay w for w ^ e. We have a decomposition 

(4-22) C- Pa — C- PatS U C- PatOUt 

into closed invariant disjoint subsets. Then the generalized character Q^ Pa (M x C M ) 
is equal to the sum 

Q K Pa , s (M x 0^) + C5^ lOUt (M x 0^) 

where both terms correspond to the specialization of the transversally elliptic sym- 
bol to the neighborhood of each part of the decomposition (|4.22|) . 

Proposition 4.2. Suppose that a ^ t* and that p, £?, TTie identity \S. 17\ ) holds 
on the subset C- Pa ^ ou t, and then 

m P =[Q K p ^ s (M xO;)] K . 

Note that C_ PiT . e = if /i + p — p a £ $(M). At this stage we know then that 
m^ = if p + p — p a does not belongs to the image of the moment map. 

4.1. Proofs of Propositions HQ and gUJ Let N = M X ~(D~ P and let ||$at|| 2 : 
iV — > M. be the square of the moment map. Recall that we denote by a the smallest 
face of the Weyl chamber so that <&(M) n t* C a. 

We want to prove that for any n = (m, £) 6 Cr(||<£>Ar|| 2 ) the vector j3 := $(m) — £ 
satisfies 

(I) ||^|| 2 +^|T„iV|>Tr^«|. 

Afterwards we will discuss the case of equality in (I) . 

The tangent space T^O p is equal to the t^-module then 

Tr^T^J = Tr^l-Tr^l 

= Tr^|«|, 

since (3 belongs to the abelian subalgebra ?£. Using that Tr^TniVl = Tr^Tm-M") + 
Tr^|6|, we see that (I) is equivalent to 

(II) || || 2 +±Tr p \T m M\ > ±Trf,\l\. 

The module t/t m is naturally a subspace of T m M. Let E m be a if TO -equivariant 
supplement to t/l m in T m M. Using that Tr \T m M\ = Tr \t/t m \ + Tr, 3 \E m \, we 
see that (II) is equivalent to 

(III) \\(3\\ 2 +lTr l3 \E m \>±Tr p \t m \. 

Thanks to the inclusion t m C £$( m ) , we see that (I) (II) (III) are induced 
by the following inequality 

(IV) ||/3|| 2 >iTr^|t $(m) |. 

Lemma 4.3. • For any (m,£) £ Cr ( 1 1 *&iv 1 1 2 ) the vector (3 := <I>(to) — £ satisfies the 
inequality (IV). 

• Let (m,£) 6 Cr(||$jv|| 2 ) such that (3 := $(m) - £ satisfies the \\ (3 || 2 = 
iTrg|t$(- m -)|. T/ien there exists a face r of a such that 

(1) per 

(2) (m, £) belongs to the K -orbit of $ L (/i + /> — p T ) x {/i + p} C JV. 
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(3) belongs to the coadjoint orbit K ■ {— p T ). 

Proof. Up to the multiplication of (to, £) by an element of K, we can assume that 
G t*. Up to the multiplication of n = (to,£) by an element of the stabilizer 
subgroup Kjj := {k G K Ad(k)0 = 0} we can assume that n = (m, w(p + p)) with 
m G M 13 and $(m) = + w(p + p) G t*. 

Up to the multiplication of n = (to, w(p + p)) by an element of the Weyl group, 
we can assume that $(to) belongs to the Weyl chamber: let r be the face of a 
containing $(m) so that K$i m ) = -Kr- 

So we have to prove that for <&(to) = a G r and w £ W the vector /3 = a—w(p+p) 
satisfies the relation 

(4-23) ||/3|| 2 > ^Tr^U 

The inequality (14.23|) is the consequence of three basic inequalities. 
We have 

(4-24) \\a-w(p + p)\\>\\a-(p + p)\\ 

for any w G W, and (|4.24|) is strict unless w G W(K T ). In order to prove (|4.24l) . 
we consider the function £ G K ■ (p + p) i — > ||£ - a|| 2 = ||a|| 2 + ||6|[ 2 - 2(£, a). It is 
a classical result of symplectic geometry that the function £ i— > (£, a) has a unique 
maximum on the coadjoint orbit K ■ (p + p) which is reached on an orbit of the 
stabilizer subgroup K a = K T . Since a and p + p belongs to the Weyl chamber, 
one checks easily that this maximum is obtained on the orbit K T (p + p). Hence 
||fc(A + p) - a\\ 2 > ||(A + p) - a\\ 2 for any k G K with equality only if k G K T . 
Inequality (|4.24p is proved by taking k = w. 
On the other hand we have 

(p + p- a, p T ) 



\\p + p-a\\ > 




a ,PT)+-J-rr(pT,p T ) 

\\Pt\\ 



(4.25) > 
Note that (|4.25p is strict unless p G t and p + p — a = p T . The third inequality is 

(4-26) ^ Traill < ||p T || \\(3\\, 

See Example EiH If we put (|4~2^)l . (|4~23)) and (|4^]) together we have 

II /3 II 2 > II/3H \\a-(p + p)\\ > || || \\p T \\ > \Trp\lr\, 

and the equality || \\ 2 ~ iTr^|t r | holds if and only if we have the equality in 
gjHD, (T4T25D and KM . 

But equalities in (|4.24[) and (|4.25p gives that w G W(K T ), p G r and a = p + p — 
p T G r. Then (m, w(p+p)) = w(mf, p+p) with $(m') = w~ 1 (p+p—p T ) = p+p—p T 
and = p + p — p T — w(p + p) = —wp T . We have then 

\Trp\lr\ - \t±M = \\p T \\ 2 



which is the equality in (|4.26D . 



□ 
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Since the strict inequality in (IV) implies the strict inequality in (I), Lemma 
l4~3l tells us that the identity ([3T7]) holds on Cp for all (3 G B p when p (£ a. When 
p G a the identity (|3.17[) holds 

(1) on Cp for the (3 which are not in K ■ (— p T ), where r is a face of a such that 

/i G T, 

(2) on C_ P(Tjt0 for all the w ^ e. 

The proof of Proposition 14.11 is completed by 

Lemma 4.4. Lei t be a face of a, distinct from a , such that p G r. XTien </ie 
identity \3.1 r /\ ) holds for Cp for (3 = —p T . 

Proof. Let (3 = ~p r . The critical set C_ Pt := K(N Pr n $^ x (-p T )) admits the 
decomposition C_ Pt = U^g^C-p^,™ where 

C-^,,,, = K (M pT n + p)- p T ) x {w^ + r)}) . 

It is not hard to see that C_ PtjU) intersects C_ PT . e only if it; G W(i<r f , T ), and that 
C-p TtW = C-p T , e when w G W(K Pt ). We know then from Lemma [4.31 that the 
strict inequality in (IV) holds on C_ PTjt0 for w ^ W{K Pt ). 

Let us consider now the case where m G M Pt n&~ 1 (p + p — p T ). We know that 
the equality holds in (IV) for (m, p + p). The equality in (I) for (m, /i + p) is then 
equivalenty to 

(4.27) Tr^J + Tr^/U =0. 

Let us prove that (|4.27|) can not holds. The image of m by the moment map 
belongs to r. Then m belongs to the symplectic slice Y T C M. A neighborhood m 
is then K x k- t Y t . So the tangent space at m decomposes in two manners 

T m M = t/t T ®T m Y T 
= t/tm © E m 

If (|4~27|) holds we see that TV^T™^ = Tr^E^I = 0, which means that /3 = 
—p T acts trivially on the tangent space T m Y T . Hence it would implies that p T acts 
trivially on the manifold Y T . Since Y a C Y T , the action of p T on the principal slice 
Y a is also trivial. 

We know that [to-, to-] acts trivially on Y a : since p a G [to-, to-], the infinitesimal 
action of p„ is trivial on Y a . Finally if (|4.27|) holds, we have that 

Pt/ct ■= Pr - Per € Ko" 

acts trivially on Y a . Note that p r i a is a sum of weights which are orthogonal to r. 

The moment polytope of M, A(M), which is equal to the closure of ^(Y a ) C a 
is a convex polytope. Since the action of p T / a is trivial on Y a we knows that the 
map £ G A (A/) i— ► (£, /V/o) is constant. 

Finally we can use the last information in our hands: p + p — p T = $(m) belongs 
to A(M). Then for £ G A(M) we have 

(£, Pt/ct) = (fJ, + p- Pt, Pt/ct) = 0, 

since p + p — p T G r and p T / a G t . It is contradictory with the fact that (£, p T / a ) = 
(£,Po) > for any £ G a. 

We have finally proved that when (m, £) G -/V Pt n $^ r 1 (— p T ) the vector /? = 
$(m) - £ satisfies || (3 || 2 +±'Tr /3 |T m M| > Tr^|t|. □ 
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4.2. Computation of the multiplicities when a = t5_. In this section we sup- 
pose that the moment polytope A(M) = <!>(M) n t+ intersects the interior of the 
Weyl chamber. Let A(M)° C (t\)° be the relative interior of the moment polytope. 
We know that m M = [Qq(M x 0^)] k for any p G K. In Definition |2~TUI we have 

defined the number Q(A^ + ) has follows. If p + p g A(M)°, we set Q(M ftt « ) = 0. 
If p + p G A(M )°, we consider, for e generic and small enough, the orbifold reduced 
space MJ^_ e := + e + p)/T and the orbifold line bundle 



-"jU+E 



S-^M+e+p) 



i&er [Qg(M x O^)]* is egwa/ to Q spin (^€ + ) 



The Spin quantization Q sp i n (M M + ) E Z is defined as the Riemann-Roch number 

RR(M%X, +e ). 
The main result of this section is the following 

Theorem 4.5. The n 

Proof. When p + p £ A(M), we see that Qq(M x O^) = since the moment 
map on M x does not goes through G t*. We have then [Qg f (M x 0^)]^ = 

Qspin(^+)=0. 

We consider now a dominant weight p such that p + p G A(M). Let Y = 
< f >_1 ((t+)°) be the symplectic slice with its canonical symplectic form ujy ■ The 
action of T on (Y, toy) is Hamiltonian with moment map $y := $|y — p. We know 
that L|y Spin-prequantizcs (Y, u>y, &y) (see Lemma [277]) . 

We consider the Riemann-Roch character RRq(Y, L\y <g>C_ M ) which is localised 
near (3>y — yu) _1 (0) C K. Thanks to the induction formula (|3. 18|) . we know that 



m M = Qf(MxO 



i K 



RR%(Y,L\ Y ®C. 



A" 



where [/ is a small neighborhood of $ y 1 (/j,) in Y. 



The computation of the expression [RR$ _ fl (U,L\u (g) 



"_ M )] T is identical to 
what we have done in Section [3.41 Forr e small enough and generic, we get 

lT _ r DD T /rr rlaiP \lT 



RR{M+ +e , Cp+e 



= Q sp i n (M M + ). 

When p + p does not belong to the relative interior of A(M), we can choose e 
so that /x + p + e £ A(M), and then RR(M^, C u+E ) = Q soin (M i u +) = 0. □ 



4.3. Computation of the multiplicities when a ^ t5_. Let e 5 so that 
p + p — p a E a. In the rest of this section the term f3 is — p„. 
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Let Q% g (M x Ofj) be the generalized character defined as the index of a transver- 
sally elliptic symbol defined in a neighborhood of 

Cp, g = A (MP n $- x (/i + p - Pa ) x {/i + p}) C N. 

K 



We have proved in the last section that 



QfJM x O m ) 



First we notice that the character g (M x O^) corresponds to the Riemann- 
Roch character RRp g (N, Ln) localized with the Kirwan vector field near Cp }g C 
Cr(||<f>Ar|| 2 ). Wc can look at N as a A/3-Hamiltonian manifold, and consider the 
Ricmann-Roch character 

localized with the Kirwan vector field near C'p := Kp(&~ 1 (p, + p — p a ) x {p + p}). 
We have prove in [18] that 

(4.28) RR$JN, L N ) = Ind^ (RR^N, L n ) A' c (l/«/s)c) 

where Ind K : R~°°(Kp) — » R~°°(K) is the induction map, and (t/tp)c is the 
complcxification of the real Kp-modu\e t/ip. It gives that 



RR« e (N,L N ) K = RR$ t t(N,L N ) A' c («/«/j)c 



A, 



Let y CT be the principal symplectic slice of M. Recall that the subgroup [K a , K a ] 
acts trivially on Y a and that p a belongs to [to-,^]: hence 

t>- 1 (p + p- Pa) C Y a C 
and then = < E >_1 (/-t + p — p a ) x {p + p}. Wc are looking at a A/3-invariant 
neighborhood U of in iV 3 . We consider the open neighborhood A Xk„ Y a of 
3> _1 (^ + p — p a ) in M, Since A/3 n A'er = T, one sees that 

Kp x T r CT c (Ax^y^Y 9 

is a A/3-invariant neighborhood of Y CT in M@. Then we can take 

U := (A> x T Y CT ) x A/3O + p) C N 13 . 

We look at U as a Hamiltonian A/3-manifold with moment map &u{[k,y],£) = 
fc$ (y) — £ 6 £g . The set is a connected component of critical points of Cr ( j | <&u 1 1 2 ) , 
and wc consider the Ricmann-Roch character 

RR^{U,-) 

localized with the Kirwan vector field near C'p C U. 

Let A/" be the normal bundle of U in N. We have TV = M\ A/2 where A/i is the 
normal bundle of A^ x^Yj in A" x ^ Y^ and A/2 is the normal bundle of Kp (p + p) 
in K(p + p). One computes that A/i = A/3 Xj- N\ where 

Ni= *( a )> 
and that A/2 = Kp x x where 

2V 2 = ^ «(<*)■ 

(a,/3)#0 
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We decompose M in the sum of the polarized bundle and M ^ . Similarly 

let Mc the complexified bundle, and its polarized /3-positive part Af^'^ ■ 

Let S , (A/J'' 3 ) = ^2k>o ^ fe (-^c~ ^ c ^ nc symmetric algebra vector bundle associ- 
ated to A/'jt'' 3 . Let us compute the rank np t + of the polarized vector bundle vector 
7V+-' 3 . We have 

np t + = (J {a > | (a, (3) > and a\ a + 0} + )J{a < | (a, (3) > 0} 

= (({a > | (a,0) > } + < | (a,f3) > 0} (1) 

In (1) we use that a\ a = imposes (a,p — p a ) = 0. Then (a,/3) = — (a,p) < 
for a > 0. Let det7V + ^ be the determinant line bundle associated to 7V +,/3 . 
Thanks to the results in [18] [Section 6.3], we know that 

(4.29) RR^ e {N,L N ) = (-l) n t ' RR*' (u, L N \ U <g> det ® S(N$ ,f, j) . 



Hence we know that m,, 



RRl- e {N,L 



N 



K 



is equal to (— l) n f times 



(4.30) 



[RRf 1 (U, L N \ U ® det M+>f* ® S{N^)) A' c (t/tp)c 
[RR* P L n \ u ® det JV^ ® 5 fc (A^^ /3 )) (6/^)c 



Let E — > W be any if^-equivariant Hermitian vector bundle. Since f3 acts trivially 
on U we can look at the Lie derivative £(/3) on E 1 . Then ijC(/3) defines for each 
x <E U & Hermitian endomorphism of E x . Let us denote 

\c{fi) > o 

I 

when all its eigenvalue on the fibers of E are stricly positive. 
We made in [18] the crucial observation 



A', 



0. 



Lemma 4.6. If \C(fi) > 0, then RR^(U,E) 

Let us compute the Lie action £(/3) on the fibers of the bundle Zjv|^®det A/" + '^( 
'(A/^). It is e, 
i£(/3) is equal to 



S k (Af^' 13 ). It is easy to check (see [19]) that on L^\u ® dctVV + ' /3 the Lie action 



11/311 



J] (l-e») J] (l-e fa ) 

(a,/3)<0 (a,/3)>0 



Look now at the Lie derivative £(/?) on A* (t/tp)c- As a T-module A* (t/^)c is 
equal to 

n c 1 -^) 

(a,/3)^0 

= (-l) 1 /2dim(A7A /3 ) e -^^ -Q (l_g»"^ 2 

(a,/3)>0 

with 5/3 = ^2( a ^) >0 ct. Notice that e - " 5 * 3 defines a character of the group Kp that 
we denote C-^ . We have proved then that 



A£(l/«/j)c = (-1)"^ + C_ 5 , 



i? 
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where the Lie derivative jC(/3) on C-^ is equal to — ($p, 0) 
derivative \C{0) on the 6^-module R is > — Tr^ |£| . 



Tr^l and the Lie 



Since ||/3|| 2 + ^Tr^A/] = Tr^t], we can conclude that the Lie derivative \C{f3) 

(1) is equal to zero on L^\u ® det A/" + ' /3 ® C-5 , 

(2) is > on L N \ U ® detAf + ' g> R, 

(3) is > on L N \u ® det ® S k (N£' P ) ® Aj(«/^)c for any fc > 1. 
With Lemma 14.61 we see that the sum (|4.30[) restricts to 



(-!)""•+ [RRf* (u,L N \ u ® detA^) ® C_ 5 , 



At this stage we have proved that the multiplicity m M is equal to 



(4.31) 



RR 



'JV w 



detA/""^) ® C 



A, 



On the symplcctic slice (Y <r ,cj a )i we have the moment map $ ff — /i relative to 
the action of Z a . The data (Y^, cl> ct , $ CT — /i) is Spin-prequantized by the line bundle 

L\ Y 

1 <T 



l-p. Let 



(4.32) 



p)- 1 {0) = $- 1 {p + p-p a )c 



U V- 1 U! ^-<| r CT >o ^— ju 

be the Riemann-Roch character localized near ($ 

Y,. 

We conluce the computation of the multiplicity m^ with the 



Lemma 4.7. VFe /iaue 



N U 



RRZ°(Y a ,L\ Y „ 



detAA+'' 3 



A,, 



(1) 

(2) 



= Q sP in(Af;). 

Proof. Let us prove that (1) is a consequence of the induction formula of Proposition 
3.91 First we notice that the data (Y a , uj a , $ CT — p, L\y a <X>C_ M ) is naturally equipped 
with an action of the maximal torus, but with a trivial action of TjZ a . So the 
generalized character (|4.32[) coincides with 

KB%{Y a ,L\ Ya 



G r- 



5 CO- 



Let us consider the Hamiltonian /^-manifold U := (i^ Y CT ) x Kg{p + p). 
Since Kp acts trivially on p a the map £ i— » £ + /v realizes a X^-equivariant sym- 
plectomorphic between the coadjoint orbits Kp{fx + p) and 

0:= Kp{p + p- p a ). 

The manifold W is then symplectomorphic to {Kp Xt Y a ) x O. Moreover, one 
sees that the generalized Riemann-Roch character RR^ (U, — ) coincides with the 
Riemann-Roch character 



RR* 13 



{{Kp x T Y a ) x O,-) 

P~ Pa)* {pl + p-Pa}). 



localized on Cq :— Kp{Q~~ 1 {p 

Since Kp PI K„ = T, the Hamiltonian T-manifold Y a corresponds to the sym- 
plectic slice of the Hamiltonian ^-manifold Kp x ^ Y CT . 
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The bundle det 7V +,/3 over {Kp x t Y a ) x O is equal to the product of Kp x t ( Cs 1 
Kp x T Y a with Kp x T C$ 2 — > 0, where 



ft 



a and £2 = 



oo 
(a,/3)>0 



(a,/3)>0 



The line bundle £jv is equal to the product of L with K Xt C- m . Then the 
restrictions of the line bundle det and Zjv to Y a X {/.i + p — are respectively 

equal to, the trivial line bundle C^+fo = C^, and to the line bundle L\y a ® C-^. 
Finally the induction formula of Proposition [379] gives that 



RB% P [U,L N \u 



>detAf + '> 3 



RRq {{Kp x T Y a ) x 0,L N \ u ®c\ctN + ' p ) 



= IncL 



Ind„ 



RR£ {Y a ,L\ Y „ ®C_ M )®Cip 

(i?<(r CT ,X| y j 



Hence 



I 



A|W 



i det 



A,-, 



Equality (2), i.e. 



RRq" (Y a ,L\y„ 



RR 2 (y ffJ i| n ®C_ M ) 
RRl°(Y a ,l\ Ya ®C_„) 

Ss Pin (M;), 



has been proved in Section 



□ 
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